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Method for Analysis of Pain Images 



BACKGROUND OF THE INVENTION 

The present invention relates to a method for recording and analyzing pain diagrams in 
which a patient or physician draws on a body image the location of pain suffered by the 
patient. Pain diagrams have been used for many years but are normally used merely for quick 
visual review to identify anatomic locations of pain. 

Pain diagrams are routinely used in pain specialist offices and in clinical trials of pain 
therapy. Previous attempts to automate analysis of pain diagrams have been of limited value 
and have not provided detailed quantitative evaluation or been applicable to all of the many 
body image designs used in medical practice. 

North et al ("Automated f pain drawing' analysis by computer-controlled, patient- 
interactive neurological stimulation system", Pain. 1992 Jul;50:51-7 and "Patient-interactive, 
computer-controlled neurological stimulation system: clinical efficacy in spinal cord 
stimulator adjustment., J Neurosurg. 1992 Jun;76:967-72; also see U.S. Patent 6,654,642) 
have used computer technology for direct recording by the patient of pain shapes. Using a 
pointing device and computer screen display, a patient with neurostimulation implants draws 
anatomic locations where pain is felt on a computerized body outline. The computer system 
adjusts the amount of electric pulse stimulation of the nerve so as to optimize pain relief. 
However, it does not provide diagnostic information or analysis of the paper pain diagrams 
used in ordinary clinical practice. 

Other workers have divided the body image into a series of rectangles using a 
transparent grid; an observer then manually records which rectangles represent painful areas. 
These data may then be coded to computer files for analysis or analyzed manually. Using a 



grid system, larger areas of pain measured have been correlated with greater disease severity 
and poorer response to treatment. Thus, Toomingas ("Characteristics of pain drawings in the 
neck-shoulder region among the working population", Int Arch Occup Environ Health. 1999 
Mar;72(2):98-106) used an 878 pixel transparent grid to classify pain location in the neck- 
shoulder area. Total pain area, left-right distribution and symmetry were correlated with 
symptom chronicity and severity of disease. Takata and Hirotani ("Pain drawing in the 
evaluation of low back pain", Int Orthop. 1995;19(6):361-6) used a grid system to show that 
patients with larger numbers of leg grid rectangles involved in pain showed poorer treatment 
outcomes. Similarly, Toomey et al ("Relationship of pain drawing scores to ratings of pain 
description and function", Clin J Pain. 1991 Dec;7:269-74) found that larger pain areas were 
related to increased disability in patients with chronic pain. 

Digital subtraction is an established computer technique used in clinical medicine, e.g., 
for magnetic resonance visualization of blood vessels. It involves computer comparisons of 
pairs of pixels across two images. Normally, a baseline image is obtained prior to some 
intervention such as injection of a radio-opaque material into a blood vessel and compared 
with an image obtained after the injection. The idea of digital subtraction dates back to the 
1930s, when the Dutch radiologist des Plantes produced subtraction images of contrast-filled 
vessels using plain film. From the "mask" image (i.e. the image of the object just before the 
contrast medium is injected) he produced a positive copy, onto which the images with contrast 
medium were overlaid to coincide, thus producing a subtraction image only displaying the 
contrast-filled vessels. Digital subtraction has not previously been used in analysis of pain 
diagrams. 

The computer generation of composite images is an established technique used in 
medicine. For example, composite images are useful in integrating the data from multiple 
frames from a magnetic resonance image of the brain, using the techniques of coregistration 
(where images are superimposed on each other) followed by display on a composite image of 
the average intensity on a gray or color scale. Composite images have not been hitherto used 
for analysis of pain diagrams. 

A further established computer technique, used in cartography, allows the user to 
"drill" up and down through different levels of detail in, for example, a map of the world. 
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Thus, Internet sites such as mapquest.com allow the user to specify an address, say in New 
York City. The Internet site then displays a map at an intermediate level of detail and the user 
can click the "Zoom Out" or "Zoom In" button so as to display progressively larger 
geographical areas (with less detail) or progressively smaller geographical areas (with more 
detail, even to the level of individual streets and buildings). This technique has not previously 
been used to display different levels of anatomic detail in pain diagrams. 

Since the late 1970s, workers in the field of comparative anatomy have used geometric 
morphometries to compare the anatomic features of different groups of organisms. Geometric 
morphometrie methods identify the location of selected anatomic landmarks and then apply 
techniques such as thin-plate spline transformation to warp an image by transforming input 
coordinates to output coordinates. Similarly, Gupta et al (U.S. Patent #5,848,121) have 
described transformation of images in digital subtraction angiography using user-provided 
match points as the basis for interpolation techniques that correct mismatches between a mask 
and an opacified image. Such methods have not hitherto been applied to match pain diagrams 
of different designs. 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to provide automated methods for recording and 

analyzing pain diagrams of human patients. 

The patient (or another person such as a physician) is given instructions as to how to 
draw, on a human body image, the locations where the subjective sensation of pain is felt by 
the patient. A drawing device such as a pen is used to identify a continuous outline for each 
pain shape. This marked-up drawing is digitized and computer-coregistered with a non- 
marked-up drawing. The computer then performs a digital extraction procedure to 
automatically identify the pain shapes recorded by the patient. The computer automatically 
calculates a number of clinically relevant measures derived from the pain location data and 
compares this dataset with a database derived from groups of patients, each group with a 
different diagnosis, a different level of disease severity or a difference in another clinical 
characteristic so as to assign the patient to one or more of these clinical groups or levels of 
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disease severity. A computerized image is generated displaying the pain shapes for the patient 
together with other clinical data such as possible diagnoses or suggested therapies. 

Aggregate pain displays for different patient groups are generated as composite images 
showing for each computer pixel location one of three displays: the proportion of patients 
with pain, the ratio of two types of pain, or an outline encompassing an absolute or 
parametric-statistics-based percentage of patients. Similarly, composite images can be 
generated for individual patients with multiple pain recordings. 

Many different body image designs are used at different pharmaceutical companies 
and by different pain specialists, and the present invention provides the means to map each 
body image design to any other body design by identifying selected anatomic landmarks 
common to each body design as well as a digitized outline of the body outline. This permits 
comparison of data between different body image designs and display of all pain data from 
disparate designs in a single body image design. It also permits other types of mapping: 
between bilaterally symmetrical areas on the left and right of the body, between common 
points on the outlines of different views of the body (e.g., the front and the back), between a 
generic pain diagram suitable for patient groups and a patient-specific body image (e.g., based 
on a photograph of the body), between a scale of linked body images in which the nature and 
degree of anatomic detail varies (allowing a visual pain data display to drill up and down 
through different magnification scales and body image rotations so as to show the desired 
anatomic detail), and between recorded pain locations and the known body surface locations 
associated with disease of individual internal body organs. 

The present invention also provides the means to differentiate between different types 
of pain information by using separate markings for each type, e.g., using separate color hues 
or intensities, or different symbols or hatching marks. Thus, for example, a human body 
image can be generated in which anatomic locations associated with nociceptive pain are 
shown in green, and locations associated with neuropathic pain are shown in blue. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a flow chart illustrating the process in accordance with the invention of taking an 
unmarked body image and an image with pain markings and processing the images by 
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computer to produce the outline of a pain shape together with suggested diagnoses or other 
clinical groupings; 

Figs. 2 a-e shows examples of an unmarked pain diagram, a diagram with a patient's pain 
markings, and a diagram with a computer-generated pain shape, generated according to the 
process in Fig. 1 ; 

Fig. 3 is a flow chart in which a computer monitor display and previously digitized versions of 
body images are used to perform the processes described in Fig. 1 ; 

Fig. 4 is a flow chart in which possible diagnoses are obtained by the patient selecting from 
multiple pre-selected pain locations; 

Figs. 5 a-e shows examples of body images, used in the process described in Fig. 4; 

Fig. 6 is a flow chart in which a visual display is generated by computer to display a pain 
outline for an actual patient together with coded displays of related clinical information; 

Fig. 7 shows an example of a visual display generated according to the process in Fig. 6; 

Fig. 8 is a flow chart in which body-area-specific masks are used to allocate pain shapes to 
specific body areas based on the location of the pain shape centroids; 

Figs. 9 a and 9 b show examples of body-area-specific masks used in the process described in 
Fig. 8; 

Fig. 10 is a flow chart in which anatomic landmarks are added to a human body image and 
associated with instructions for identifying such landmarks; 



Fig. 1 1 shows examples of anatomic landmarks identified in accordance with the process 
described in Fig. 10; 
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Fig. 12 shows a human body image in which centroids are used as markers of pain location. 
The meta-centroid for the centroids is also displayed; 

Fig. 13 is a flow chart in which pain markings of sub-optimal quality are edited so as to 
provide good quality pain markings for computer analysis; 

Figs. 14 a and 14 b show two examples of sub-optimal pain markings that may be converted 
to good quality pain markings in accordance with the process in Fig. 13; 

Fig. 1 5 is a flow chart in which pain location and pain quality variables are combined to 
provide improved diagnostic precision; 

Fig. 16 is a flow chart illustrating the process of generating composite images of three types 
from a set of individual pain outlines; 

Fig. 17 shows an example of one type of composite image generated using the process in Fig. 
16; 

Fig. 18 is a flow chart in accordance with the invention in which individual pixels in two 
separate human body image designs are mapped to each other, allowing transfer of pain data 
recorded in one image to comparable locations in the other image; 

Fig. 19 shows examples of anatomic landmarks used as a basis for the mapping process 
described in Fig. 18; and 

Figs. 20 a-o show examples of the many different human body image designs used in the 
evaluation of pain, indicating the need for the process described in Fig. 18. 
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DESCRIPTION OF PREFERRED EMBODIMENTS 

The present invention relates to a method for recording and analyzing the locations 
where pain is experienced by a patient, as recorded by a patient or physician drawing on a 
body image. 

Definitions of Key Terms: 

Affine Transformation: A mathematical transformation that is a combination of single 
transformations such as translation or rotation or reflection on an axis. In a typical 
affine transformation, given a matrix M, and a Vector V in homogeneous coordinates 
(e.g. V=(X Y then V-MV where V 1 is the new vector in the transformed space. 

Centroid and Meta-Centroid: As it applies to visual images, a centroid represents the 
mean position of the points making up a visual object. A meta-centroid is the point 
representing the mean position of a group of visual objects, and may be calculated as 
the mean position of the individual un-weighted centroids or as the mean position of 
all the points making up the group of visual objects. 

Composite Image: An image that is created by a combination of multiple images on a 
single sheet or display. 

Coregister: A process by which two or more images are spatially normalized with 
respect to one another. One such process uses fiducial points and linear transforms 
(translation, rotation, zoom and shear) so as to allow digital superimposition of 
common structures contained in the images. 

Digital Subtraction: A method for showing a selected element of an image without any 
interfering background. A first "mask" image (see "Image Masking" definition below) 
is compared with a second image obtained after display of the selected element. The 
computer digitally subtracts the first image data from the second image, leaving only 
the display of the selected element. 

Distance Map: A grey level image, where the value of each point of the foreground 
corresponds to its shortest distance to the background. 
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Drill Up and Down: A technique usually performed by a computer, in which visual or 
non- visual data can be displayed at different levels of detail Drilling up means that 
less detail is provided for any given object, whereas more objects can be displayed. 
Drilling down is the opposite. 

Ellipse: An oval figure, bounded by a regular curve, which corresponds to an oblique 
projection of a circle, or an oblique section of a cone through its opposite sides. The 
greatest diameter of the ellipse is the major axis, and the least diameter is the minor 
axis. 

Erosion Operators: Erosion operators allow pixels on the outside of a shape to be 
discarded if they exceed preset values for the operators, causing "erosion" of the 
shape. Distance operators can use a recomputed distance map. Morphological 
operators compute the minimum and maximum pixel values within a certain scope. 

Fiducial: A point of reference, such as the center of a cross-hair in a visual image, used 
as a standard of reference of comparison and applicable to the process of 
coregistration. 

Geometric Morphometries: Geometric morphometries represent a collection of 
approaches for the multivariate statistical analysis of Cartesian coordinate data, usually 
limited to landmark point locations. Kendall's shape space geometry (the estimation of 
mean shapes and the description of sample variation of shape using the geometry of 
Procrustes distance) is used. 

Image Mapping: The process whereby each pixel on one image is associated with (i.e., 
mapped to) a pixel on another image. As an example, the pixel at the center of the 
pupil of the right eye on a first image of a human body is associated with the pixel at 
the center of the pupil of the right eye on a second image of a human body. 

Image Masking: A cropping technique that uses a mask image to identify portions of 
an image that should be ignored ("masked") in subsequent analysis or display. 
Masking may use a separate coregistered image, or the image to be masked may itself 
contain the masking information. Optimally, masking is performed on a pixel-by-pixel 
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basis, with each pixel being associated with a component that determines whether the 
pixel will be masked. 

Image Warping: A process whereby a Cartesian coordinate grid is applied to a 
reference image and the image and grid then distorted so as to match the reference 
image to a target image. 

Pain Diagram: A diagram or other image of a human body (normally of the front and 
back of the body) that is used as a guide in specifying the location of the patient's pain. 

Pain Drawing: A drawing of pain location made on a pain diagram. The term "pain 
drawing" is sometimes used interchangeably with "pain diagram". 

Pixel: The smallest discrete component of an image. 

Radial: A line radiating from a common center. 

RGB Color Coding: A coding system for three colors of light (Red, Green, Blue) that 
can be mixed to produce other colors. These colors correspond to the three color 
receptors in the human eye. Colored images are often stored on a computer as a 
sequence of RGB triplets (e.g., White = 255,255,255; Black = 0,0,0; Red = 255,0,0; 
Green = 0,255,0; Blue = 0,0,255). 

Thin-Plate Spline Interpolation: A thin-plate spline is the surface with minimum mean 
square second derivative energy that interpolates a given collection of points. Classical 
thin-plate spline techniques (or simple extensions of these techniques) can be used to 
map common locations between different images for which a number of common 
landmarks have already been identified. 

Pain diagrams (also known as pain drawings) have been used by physicians for at least 
40 years to identify pain location. Although they are clinically useful, the lack of a method for 
extracting and analyzing the pain location information has prevented their being used to full 
advantage. Frederick Wolfe (J Rheumatol 2003;30:369-78) has stated that pain diagrams 
". . .are difficult and time consuming to score" but that "clinicians can get a quick and useful 
picture of a patient's pain by just looking at a drawing . . 
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Several previous attempts have been made to computerize pain diagrams but these 
have not resulted in their common use in ordinary medical practice. No workers have 
developed an automated, quantitative, diagnostic method for analyzing pain location data 
drawn on pain diagrams. In addition, pain diagrams of many different designs are used by pain 
specialists and pharmaceutical companies around the world, so that any method and system to 
analyze all such data would have to work effectively for each of these many body image 
designs. 

COMPUTER IDENTIFICATION OF PAIN SHAPE MARKINGS ON A 
HUMAN BODY IMAGE 

The present invention digitizes a body image on which the pain locations for a patient 

have been recorded, compares the resulting digitized image to a digitized image of an 

unmarked body image (on which no pain locations have been recorded), and automatically 

determines pain locations by digitally subtracting, on a pixel-by-pixel basis, the data on the 

unmarked image from that on the patient-drawn image. All images use common fiducial 

points on the image to coregister all images to the same coordinate space (using an affine 

transformation comprising a combination of the single transformations of translation, rotation, 

shear and scale). The pain locations for each patient are then compared with a database 

containing patients in various clinical groups (e.g., based on diagnosis, pain type or disease 

severity) and patients are allocated to one or more clinical groups. 

Automated identification of pain shapes can be performed for any of the many varieties of 
body image designs used in the medical community. Thus, the digital subtraction process is 
based on a digitized image of an unmarked copy of the particular body image design being 
used. 

In the present invention, a computer automatically detects each pain shape drawn and 
calculates a number of data items related to the pain shape, including the size (calculated 
area), centroid, outline, shape type, and anatomic areas occupied by the pain. In addition, 
computationally and analytically simpler surrogates of certain measures may be used. For 
example, most pain shapes are approximately elliptical in shape and the pain outline can be 
conveniently approximated by calculating an ellipse derived from the long and short axes of 
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the pain shapes; ellipsoid data is simpler to analyze when aggregating data from groups of 
patients. 

It is well known to those skilled in the art that the location of pain in the body is closely 
related to the underlying diagnosis. Thus, pain in the lower back, the knee, the shoulder, or 
the hip is most commonly associated with degenerative disease of the structures in those 
locations (joints, inter-vertebral disks, cartilage, bursae, tendons, etc.); these types of pain are 
termed "nociceptive". In contrast, pain in the leg in the distribution of the L5 or SI nerves is 
likely to be caused by sciatica related to irritation of those nerves as they exit the spine; 
similarly, bilateral generalized pain in the feet and lower legs is commonly caused by 
peripheral neuropathy; these types of pain are termed "neuropathic". However, no systematic 
studies have hitherto been performed that precisely identify the distribution of pain in these 
conditions. The systematic, quantitative collection of data made possible by the present 
invention remedies this defect. 

Statistical analysis of pain shape data is used to identify the pain patterns that differentiate 
different patient groups, for example, groups identified by diagnosis, disease severity or other 
clinical variables. The pain shape of an individual patient can then be compared with these 
pain patterns, allowing assessment of the probability of the patient belonging to a particular 
diagnostic or other grouping. 

Various statistical techniques may be used to identify pain patterns. One technique is to 
use the centroid of a pain shape and the calculated area of a pain shape, two variables that 
effectively differentiate between pain patterns associated with different diagnoses. Thus, the 
location of the centroid for a given patient can be compared statistically with the locations for 
the centroids associated with each particular diagnosis, and a list of diagnoses in order of 
probability generated. For diagnostic categories that may overlap in centroid location, 
inclusion of the size of the pain shape may differentiate between these overlapping categories. 
Thus, pain involving the knee may be localized (and usually representative of local knee 
disease) or more generally distributed above and below the knee (for example in some patients 
with sciatica); these two types of patients may be easily differentiated by measures of the size 
of the pain shape (such as the calculated pain area or the length of the vertical axis of the pain 
shape). Similarly, neuropathic pain can be differentiated from nociceptive pain not only by the 
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location of the centroid but also by the total calculated pain area (which is normally of larger 
size in neuropathic pain). An alternative approach is to use the generalized Hausdorff measure 
(a means of determining the resemblance of one point set to another, by examining the 
fraction of points in one set that lie near points in the other set) to calculate the closeness of a 
given patient's pain shape to the group pain shape associated with a particular diagnosis. 

In addition to determining the pain patterns of groups for which the members are already 
known (e.g., patients with localized nociceptive knee pain), data-driven clusters of patients 
with particular pain patterns may be identified using the technique of cluster analysis which 
generates a dendrogram (tree diagram). Selection of the number of clusters to retain in a 
cluster analysis can be determined by replicating the analysis in separate datasets or in data 
subsets, and by determining which clusters reflect clinical realities. Such factor analysis can 
provide insights across or within clinical groupings. 

The basic methodology described above may be enhanced by the following refinements: 

DISPLAY OF DIGITIZED HUMAN BODY IMAGE ON COMPUTER MONITOR 
FOR PRODUCTION OF PAIN MARKINGS 

Hard copies of pain diagrams are normally used and these may be digitized 
after the pain shapes have been recorded. However, a patient or physician may also 
interact with a computer, display monitor and pointing device to record pain 
information, rather than drawing pain shapes on a hard copy. Personal details such as 
age, sex, height, weight, ethnic group, and build are entered, and this information can 
be used to bring up a body image that is the closest match to the patient's own body. 
A pointing device such as a mouse is then used to draw the shapes of pain on the body 
image. The patient may also indicate, using a designated signal such as a mouse click, 
the point where the pain is worst. 

Where the pain shape is recorded by direct interaction with the computer, the 
computer can "drill down" to the areas of pain, presenting a more detailed view with 
anatomical structures labeled, and superimposing the pain shape already identified. 
This allows the pain shape to be edited to provide more precise anatomic detail. 
Additional views can be displayed in the drilled-down presentation (for example, a 
patient indicating pain on the medial side of the right knee in an anterior view can be 
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shown an additional view that shows the right knee from the medial aspect and not just 
from the anterior and posterior aspects of the knee). The computer can then drill back 
up to the full body image with a more accurate picture of the pain shapes. 

FITTING OF PATIENT PAIN PATTERN TO PREDETERMINED PAIN 
PATTERNS 

In a further approach, the patient is asked if the pain location fits one of several 
predetermined pain locations identified from pain patterns seen in a large group of 
pain patients. Since pain shape centroids provide stable measures of pain location, a 
particularly valuable application of this approach is to ask the patient if the center of 
the pain is located inside a visually displayed predetermined pain location. Normally, 
to avoid influencing the patient excessively, this approach may be applied after the 
original pain drawing has been obtained in an unbiased manner. For example, this 
approach may facilitate categorization of the patient's pain into one of several types of 
knee pain (such as femoro-patellar syndrome, injury of the medial meniscus or medial 
ligament, injury of the lateral meniscus or lateral ligament, prepatellar bursitis, 
anserine bursitis, or Baker's cyst). 

VISUAL SUMMARY OF PAIN LOCATIONS AND CLINICAL FEATURES 

After the pain shapes have been delineated, a computerized image can be 
generated for each patient showing the pain shapes, together with a listing of possible 
diagnoses or other clinical characteristics associated with the pain locations. The 
patient or physician can be provided with a computer monitor display or hard copy 
(combining graphics and text) that specifies possible diagnoses based on the pain 
distribution pattern described by groups of patients with known pain specialist 
diagnoses and completed pain diagrams. Any of many types of coding system can be 
used to designate the nature of the clinical information to be displayed. This can 
include textual descriptions (which can be visually linked to a pain location by an 
arrow), and various identifying markers (such as color hues or intensities, a gray scale, 
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black and white hatching, or stippling) for a body location or pain shape together with 
a coding key that matches the marker with a textual description of its meaning. 

BODY- AREA-SPECIFIC MASKS 

Since painful areas of different etiology can occur in different body locations, a 
mask image can be used to identify those pain shapes for which the centroid is present 
inside a predefined portion of the body image. For example, if the area of interest is 
the lower back, each pain shape can be reviewed to identify if the centroid of the pain 
shape is contained within a body image mask confined to an area of the lower back 
typically associated with the centroids of pain shapes from other lower back pain 
patients. The mask is coregistered with the image containing the pain data. A 
computer program can apply several different masks, each evaluating pain in a 
particular body location. 

USE OF BOTH VISIBLE AND PALPABLE ANATOMIC LANDMARKS 

Most anatomic landmarks in human body images represent locations that can 
be identified by visual inspection of a human body. However, a further method of the 
present invention uses anatomic landmarks that may not be visible but which the 
person recording the pain shape can feel. This is particularly useful for anatomic areas 
where the patient himself finds it difficult to confirm location by visual inspection, for 
example on the back of the body, or in obese patients where fat may obscure common 
landmarks. An example is the lower back where the bony protuberances of the 
posterior iliac spine, the L4/L5 vertebral spines, and the upper edge of the sacrum can 
be identified by the physician and perhaps by the patient also. 

The different types of anatomic landmarks can be associated with different 
methods of visual display. The level of detail in different portions of a body image 
may be adjusted so as to reflect medical importance and disease frequency. For 
example, the head, lower back, knee, shoulder, hip and foot areas are common 
anatomic areas of pain and it is useful for the body image to emphasize visual or 
palpable anatomic landmarks in these areas. Dotted lines or lines of different width or 
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shading and the techniques of non-photorealistic rendering may be used to focus the 
attention of the person recording the pain shape on certain anatomic features in areas 
commonly associated with pain (e.g., bony protuberances that can be felt on the 
outside of the body, and other structures underneath the body surface). The curvature 
of the body outline can also be enhanced in such areas as a means of emphasizing 
these features. Instructions to the pain recording person are given and include means 
for location of each landmark. 

CENTROIDS AS STABLE MARKERS OF PAIN LOCATION 

Pain shapes drawn on a body image tend to be of many different sizes and 
contours. However, the calculated centroid (the mean position of the points making up 
the pain shape) provides a stable marker of pain location. Thus, the outlines of 
shoulder pain shapes may be very variable, but the centroids for such pain shapes tend 
to be closely clustered in a small anatomic area. Mathematical techniques such as 
cluster analysis may be applied to a group of centroids to identify data-driven local 
peaks representing anatomical concentrations of pain ("pain clusters"). A more 
powerful separation of patient groups may be obtained by combining centroid data 
with other data. For example, patients with nociceptive pain tend to have small, 
localized areas of pain whereas patients with neuropathic disease tend to have larger 
pain shapes - a finding that has both diagnostic value and possible implications for the 
underlying pathogenesis of pain in nociceptive and neuropathic disease. Special 
analysis, for example incorporating both centroid location and the major and minor 
axes of the fitted centroids, may allow separation into primarily neuropathic and 
primarily nociceptive pain types even where the centroids overlap. 

COMPUTER DIFFERENTIATION OF BACKGROUND AND PAIN MARKINGS 
BY USE OF DIFFERENT COLORS 

A further method facilitates computer differentiation between the underlying 
body image outline and the patient's drawing by using one color (e.g., cyan) for the 
background diagram and another color (e.g., markings from a black pen) for the 
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patient's drawing. The essential requirement for this approach is for the two colors to 
be distinguishable in at least one of the three constituent RGB colors. In the case of 
cyan and black, for example, the RGB signatures are 0, 255, 255 (cyan) and 0, 0, 0 
(black). Thus, with appropriately chosen threshold levels for the various color 
channels, the computer can distinguish regions of the images that contain the original 
body image markings (i.e., prior to addition of any pain markings), the patient's pain 
markings, both or neither. 



EDITING OF PAIN MARKINGS PRIOR TO COMPUTER MEASUREMENT OF 
PAIN SHAPE 

One of the purposes of the present invention is to analyze pain diagrams that 
exist in the files of many different pharmaceutical companies and pain specialist 
offices. These legacy pain diagrams share two analysis problems: 

The first problem is to map the many different body image designs to each 
other or a common body image design - this problem is solved by the mapping 
methods used in the present invention. 

The second problem is that many different methods, and different instructions 
for those drawing the pain shapes, may have been used for recording the pain shapes - 
and this problem is addressed by human or computer editing that transform the pain 
markings into pain shape outlines that can be read using a computer-based analysis 
procedure. 

The first step in addressing the second problem is to identify the pain 
markings automatically using the coregistered images and digital subtraction 
procedure described above. 

The second step is to determine whether or not such pain markings on a 
specific body image represent a single pain shape with a continuous outline - 
in which case, analysis can proceed without editing of the pain markings. 

The third step, for patients with more than one pain shape identified, is 
to determine whether some or all of the multiple pain shapes can properly be 
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combined as a single pain shape. There are two legitimate ways of performing 
this combining step - a human review method, and a computer method. In the 
human review method, a trained, unbiased observer (who is unaware of the 
clinical features of the patient, such as diagnosis or treatment assignment) 
evaluates the pain markings and draws the edited outline of a pain shape or 
outlines of multiple pain shapes (on a paper copy that is subsequently digitized, 
or on a computer screen using a marking device). In the computer method, a set 
of computer algorithms that evaluate factors such as the type of markings (e.g., 
hatched or stippled), the distance between nearby pain shapes, and 
correspondence to established pain patterns in other patients, is applied to 
perform a similar combining function. Using either method, it may also be 
determined that no valid pain shape data are available in a given pain diagram 
for a given data analysis. 

Both human and computer editing of pain markings should apply 
similar methods that depend on the nature of the deficiencies in pain markings. 
One common deficiency is that the pain shape is indicated by hatching or 
stippling rather than a single continuous outline - this can normally be 
remedied by human or computer drawing of an outline that encompasses all the 
hatching or stippled elements - the same procedure being used for all pain 
markings to be included in a particular data analysis. A second common 
deficiency is that an arrow is drawn to a particular body area but no indication 
of the extent of the pain shape is provided - in such cases, the pain can be 
assigned to one of a set of predetermined body areas, but no analysis involving 
the size of the pain shape can be performed. 

A key consideration in valid human editing of pain markings is that the 
process be consistent and unbiased - it is essential that the human editors be 
trained in consistent application of the editing procedures and that no clinical 
details or drug assignments are provided to bias the editing procedure. In the 
case of computer editing, no single algorithm is likely to be suitable for editing 
all pain markings - rather, a preliminary (human or computer) assessment 
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should be made as to what particular defect in pain recording is present, and 
then the appropriate computer algorithm applied. It may also be appropriate to 
have unbiased human review of the computer-determined pain outlines to 
detect cases where the computer procedure clearly did not work effectively. 

In all clinical studies, the same recording instructions are likely to have 
been given for all patients, regardless of treatment group. Accordingly, it will 
normally be possible to perform an unedited and unbiased analysis of the pain 
markings, even in patient groups for which inferior pain recording methods 
were used; thus, some analysis and inter-group comparison should be feasible 
and clinically useful - e.g., generation of a composite image with color 
intensity based on the numbers of patients in the group with pain at a given 
pixel. However, in some cases the quality of the pain markings may be so poor 
that neither a human observer nor a computer algorithm can reliably determine 
a pain shape outline, and such diagrams should not be subjected to any analysis 
that requires a pain shape outline. 

PAIN DIAGNOSIS BY COMBINATION OF PAIN LOCATION AND PAIN 
QUALITY DATA 

Although the pain location information by itself is a powerful aid to diagnosis, 
even greater diagnostic precision may be obtained by combining pain location 
information with other clinical data on the patient, e.g., information about the quality 
of the symptoms experienced by the patient. Thus, it is well known to those skilled in 
the art that neuropathic pain is associated with sensations such as numbness, pins and 
needles, a feeling like electrical shocks, a hot/burning feeling, or worsening of the pain 
with light touching. Thus, a diagnosis of neuropathic pain can be more accurately 
identified if pain location and pain quality data are combined. Since many patients 
have several different locations containing pain shapes, and these pain shapes may be 
related to different medical conditions, it is important to ensure that the pain quality 
data collection is specifically focused on pain in individual locations. 
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RECORDING OF PAIN MARKINGS ON PHOTOGRAPH OF ACTUAL PATIENT 
WITH PAIN 

Traditionally, pain drawings have used generic unisex diagrams of the human 
body that do not take into account individual features of a given patient. The shape of 
the human body is very variable from individual to individual, depending on such 
factors as age, sex, ethnic background, body build, and obesity. All such factors can 
be taken into account by using a photograph of the actual patient suffering pain, on 
which photograph the patient can mark the actual locations of pain. These pain 
markings can be transferred to a mapped generic human body image for inclusion in 
analysis of similarities and differences from pain markings of other patients. With the 
widespread availability of digital cameras, digitized photographs are easy to produce 
(and may optionally be edited to identify relevant anatomic landmarks). Since a patient 
may more easily record pain shapes on an image of his or her own body, accurate 
recording is facilitated. Use of photographs is particularly suitable where a single 
patient records pain on large numbers of occasions, thus justifying preparation of a 
patient-specific blank body image. 



COMPOSITE IMAGES AND AGGREGATE ANALYSES OF PAIN 
CHARACTERISTICS FOR PATIENT GROUPS 

The present invention can generate a composite image for one or more patient 
groups that displays the pain location for the group as a whole. 

A composite image can be generated in several ways, all of which require a 
coding system that relates a given identifying marker to a given clinical characteristic. 
Display of identifying marker data may use different color hues or intensities, or 
different monochrome patterns. In addition, textual descriptions can relate specified 
groups of pixels to clinical characteristics. 

Such approaches can use before-and-after composite images to provide a visual 
demonstration of the efficacy of a particular treatment suitable, for example, for 
marketing use by pharmaceutical companies. For many years, pharmaceutical 
companies developing medications to control pain have used pain diagrams in their 

22 



clinical trials. Using the present invention, these pain diagram data from clinical trials 
are now accessible to formal, quantitative analysis that could provide important 
marketing or medical uses - such as before-and-after composite images in drug and 
placebo treatment groups, or identification of probable responders to drug therapy (as a 
function of variables derived from a baseline pain shape). In addition, important 
insights into the distribution patterns of clinical pain may be achieved since the data in 
all the disparate body image designs used in different clinical trials can be transformed 
into comparable data in a single generic body image design. For complex composite 
images, explanatory text (optionally color-coded) can be added. A composite image 
may also be generated to show the different body locations associated with two or 
more different characteristics - e.g., nociceptive and neuropathic pain. 

SMOOOTHING OF COMPOSITE IMAGE BY PARAMETRIC STATISTICS 

The present invention can also generate composite images using 
parametric statistics and statistical probabilities (rather than actual raw data). 
Images can be created that show a smooth gradation in intensity of the 
composite image from the center of a pain location (say the lower back) to the 
periphery of the pain location. 

Each pain shape for a given patient has an outline indicating the outside 
of the pain shape. In the present invention, instead of plotting the color 
intensity for a pixel purely as a function of the number of patients in the group 
whose pain is present at a particular pixel, a separate composite image may be 
generated where the color intensity (or some other visual variable) represents 
the statistical probability of a given patient in the group having pain present at 
that pixel. This approach supplements the discontinuous, patchy composite 
image based on the actual number of patients with pain at that pixel with the 
statistical probability of a patient in the group having pain at that pixel, 
resulting in a continuous gradation of color or gray scale intensity and a better 
representation of the underlying distribution of pain. In one approach, the 
value of the visual variable may be a function of the distance from the group 
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meta-centroid with the visual display being based on such standard statistical 
values as the mean, standard deviation, and standard error of the mean. 

A number of reservations should be applied in evaluating this 
parametric statistics approach: 

It applies certain simplifying statistical assumptions, such as 
calculation of the normal (Gaussian) distribution around the meta- 
centroid. Most biological data have an approximately normal 
distribution and perform in accordance with the Central Limit Theorem. 
However, is may sometimes be appropriate to apply tests for normality 
(e.g., the Pearson and Kolmogorov-Smirnov tests) to determine the 
degree to which the dataset comes from a normally distributed 
population. 

. Certain composite images may be confined to certain body 
areas, so that pain shapes are artificially truncated at the edge of the 
body area mask that is used. An example is where a patient may have 
both nociceptive low back pain and neuropathic sciatica and it is 
desired to separate these two pains by creating a back pain mask and a 
sciatica mask with the dividing line being the posterior iliac spine and 
superior edge of the sacrum. 

Separate sets of parametric statistics are calculated for each 
radial around the meta-centroid. A statistical value for a particular 
radial (such as the mean distance + 1 standard deviation which for an 
individual radial encompasses about 80 % of observations) has a 
discrete probability of an outline lying inside the statistical value. 
However, it is less simple to calculate the probability of any portion of 
a pain shape lying inside a parametric statistics-based outline derived 
from a combination of data on all radials. 

Importantly, the purpose of this approach is to assist the 
physician in deciding if the location of the pain shape outline in a 
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particular patient is consistent with a particular diagnosis and 
inconsistent with other diagnoses. This requires knowledge of the 
relevant sensitivity (for detecting patients with such a diagnosis) and 
specificity (for excluding patients with other diagnosis). This will vary 
from diagnosis to diagnosis and can only be determined by acquisition 
of pain shape data on an adequate number of patients with and without 
the diagnosis. However, for the first time, the method of the present 
invention provides a means of acquiring the quantitative information 
required to make these determinations. 

INTEGRATION OF PAIN DATA FROM BODY IMAGES OF DIFFERENT 
DESIGN 

A further method allows interchange of data and visual displays between disparate body 
image designs. 

The coordinates of selected common anatomic landmarks on the outline of the body image 
or within this outline are recorded for each body image design using user identification by a 
pointing device (this method being optionally supplemented by computer-assisted 
identification of landmarks). For most anatomic locations, a landmark is best identified by the 
user clicking with a pointing device at the anatomic location. In some such cases, the 
computer can refine the user's approximate estimate of anatomic location, e.g., where the user 
clicks on a body curve on the outline of the body and the computer finds the point in that 
general area that represents the maximum curve of the body outline. This approach may 
optionally be used to identify, for example, the tip of the shoulder, the most distal point on 
each of the fingers and toes, the centroid of the eye outline, or the centroid of the mouth shape. 
For some anatomic landmarks, computer identification alone may be more reliable than 
manual identification, e.g., the vertical line in the middle that evenly divides a body image 
into left and right sides of the body, or the top of the head. 

Using common landmarks that lie along the outline of the body images, each pixel along 
the entire body outline in one body image design is mapped to the corresponding pixel in the 
other body image design. Such outline mapping may be performed in several ways, for 
example, on the basis of the relative distance between the two anatomic landmarks on either 
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side of the pixels, or using the method of Bookstein et al ("Comparing frontal cranial profiles 
in archaic and modern Homo by morphometric analysis", Anatomical Record: New 
Anatomist, 1999; 257:217-224) in which outline landmark points are mathematically slid 
along the outline curve until they match as well as possible the positions of the corresponding 
points along an outline in a reference specimen; these outline landmarks are constrained to 
retain their relative position on the outline curve. Specific mapping of outline landmarks 
ensures that each pain shape point mapped to a second human body image design will lie 
within the body image. 

In addition, using selected pixels from the mapped outlines of the body images of the two 
designs, optionally together with any common anatomic landmarks in the interior of the body 
images of the two designs, each pixel in the interior of the body image of one of the designs is 
mapped to a pixel in the interior of the body image of the other design. The method of thin- 
plate spline interpolation or variants thereof with warping of the respective spaces of the two 
designs may be used to superimpose the common elements of the two designs. 

The two body image designs can be superimposed on a computer monitor display, with 
each being displayed in its own warped space. The user can then add, reposition and delete 
landmarks until the best possible spatial mapping between the common elements of the two 
designs has been obtained. 

Many pain diagram designs used by pharmaceutical companies or pain specialists are not 
optimally designed - for example, the diagrams may not provide enough anatomic detail to 
link the pain shape to the anatomic location or underlying structure, or may not be bilaterally 
symmetrical. Transfer of the pain data to a more optimally designed body image design may 
disclose additional useful information. 

In addition, transfer of data from disparate body image designs to a single optimum body 
design can allow comparison of pain diagram data obtained in clinical studies of different 
design. This allows combined analysis of therapeutic or diagnostic pain data from different 
clinical studies. These mapping techniques may be supplemented by additional methods to 
achieve the following: 
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TRANSFER OF RECORDED PAIN DATA BETWEEN A GENERIC BODY 
IMAGE AND A PATIENT-SPECIFIC BODY IMAGE 

A further method transfers pain data collected using a generic body image to 
the same anatomic areas on a photograph specific to the patient whose pain is being 
recorded. In like manner, data recorded on a patient-specific photograph-based pain 
diagram can be transferred to a generic pain diagram for analysis of group data. 

TRANSFER OF RECORDED PAIN DATA BETWEEN A GENERIC BODY 
IMAGE AND A DEMOGRAPHIC-BASED BODY IMAGE 

A further method transfers pain data collected using a generic body image to 
the same anatomic areas on a body image specific to the demographic group to which 
the patient belongs (e.g., according to age, sex, ethnic group, or body size). In like 
manner, data recorded on a demographic-based body image can be transferred to a 
generic body image for analysis of group data. 

LINKED SCALE OF PAIN DIAGRAMS WITH DIFFERENT LEVELS OF 
ANATOMIC DETAIL 

A further method involves the design of a linked scale of pain diagrams with 
different levels of anatomic detail, each coregistered with the others, so that the user 
can drill up or drill down through the diagrams to record and display data at the 
desired level of detail and emphasis. 

MAPPING OF EXTERNAL BODY SURFACE TO INTERNAL BODY 
STRUCTURES 

A further method maps the external surface of the body to internal body 
structures, providing additional information of possible diagnostic value. For 
example, pain in the body surface area overlying the kidneys may suggest urinary 
infection. However, since body structures may migrate during the embryonic stage, 
pain originating from a particular organ such as the heart may not necessarily be 
located in the skin over the organ. Thus, mapping to the external body surface must 
take into account the typical locations for pain originating from particular organs. 
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INTEGRATED ANALYSIS OF LEFT- AND RIGHT-SIDED BODY PAIN 

The human body is in large part bilaterally symmetrical and it is sometimes 
clinically useful to combine or compare information from both sides of the body; this 
can be achieved in the present invention which allows mapping of the left and right 
sides of the body to each other. For example, a patient may have pain in both knees 
but the actual location of the knee pain may differ between the knees. Similarly, in a 
clinical study of a new drug, it may be useful to transform left-sided sciatica data into 
right-sided sciatica data, thus increasing the sample size available for analysis of the 
drug's effects on sciatica pain. 

CONTIGUOUS PAIN SHAPES IN DIFFERENT BODY VIEWS 

A further method maps the front and back of the body image using common 
anatomic landmarks seen from both front and back. This allows application of an 
algorithm that determines if there is a single contiguous pain shape (e.g., on the front 
and back of the left shoulder, allowing integrated analysis of the entire left shoulder). 

Referring to the drawings, Fig. 1 is a flow chart showing an unmarked human body 
image 2 and a human body image with pain markings 4. These two images are digitized and 
coregistered, and digital subtraction is performed 6 to produce a digitized human body image 
containing a computer-identified pain outline 8. 

Computer identification of the pain shape outline is performed using the following 

steps: 

a) Set a threshold value for a pixel variable that allows differentiation between the 
human body image and the drawn pain shape: 

Threshold the patient drawn image to determine a set of pixels that were 
actually drawn on to indicate areas of pain. 

b) Calculate the distance map for the image: 
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Calculate the distance map (a grey level image where the value of each point of 
the foreground corresponds to its shortest distance to the background) for the 
image from step a) where the drawn pixels are at distance=0. 

c) Set a threshold for distance map values within which pixels will be provisionally 
considered part of the same pain shape: 

Threshold on distance the image from step b) all pixels which are less than a 
preset threshold. 

d) Starting at the outer border of the provisional pain shape, discard pixels that exceed 
preset values for erosion operators: 

Erode the image from step c) using either distance based or morphological 
based erosion operators. 

This pain outline is then analyzed 10 by computer to calculate various pain measures 
including the calculated area occupied by the pain shape, the center of the pain shape, and the 
anatomic location involved. The values of these pain measures are then compared 12 with 
those in a database of pain patients with various known clinical characteristics, and possible 
diagnoses and other clinical groupings 14 may be produced for the patient. 

Figs. 2a-e show examples of body images, generated according to the process in Fig. 1. 
Fig 2a shows an unmarked body image. Fig 2b shows a patient's right anterior shoulder pain 
markings (a magnified portion of which is shown in Fig 2d). Fig 2c shows a computer- 
identified shoulder pain shape (a magnified portion of which is shown in Fig 2e). 

Fig. 3 is a flow chart in which a digitized unmarked human body image 22 is displayed 
23 on a computer screen and a patient's pain is electronically drawn 24 on this image resulting 
in a digitized human body image 25 with pain markings. The body images 22 and 25 are 
coregistered and digital subtraction is performed 26, resulting in a digitized body image 28 
containing a computer-identified pain outline. This image is then processed as in steps 10, 12 
and 14 of Fig. 1. 
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Fig. 4 is a flow chart in which multiple pre-selected pain locations 30, 32, 34, 36, 38 
suggesting particular diagnoses are displayed 40 to a patient with pain, so that the patient may 
select 42 that pain pattern which most closely resembles the patient's own pain pattern so as 
to identify 44 the most likely diagnosis. 

Figs. 5 a-e shows examples of body images, used in the process described in Fig. 4, 
showing pre-selected patterns of pain location of the shoulder (Fig 5 a), hip (Fig 5 b), knee 
(Fig 5 c), lower back (Fig 5 d), and the bilateral pain in the foot and lower leg typical of 
peripheral neuropathy (Fig 5 e). 

Fig. 6 is a flow chart in which a human body image 56 containing a computer- 
identified pain shape is compared 58 with pain data from different patient groups and, using a 
coding system to represent different types of clinical information 60, a visual display 62 is 
generated by computer to display a pain outline for an actual patient together with coded 
displays of related clinical information. 

Fig. 7 shows an example of a visual display 64 generated according to the process in 
Fig. 6 in which lower back pain and sciatica pain shapes are displayed and associated with 
related textual clinical information. 

Fig. 8 is a flow chart in which a human body image 66 with a computer-generated pain 
shape and calculated centroid is analyzed using a sequence of body-area-specific masks 68, 
70, 72, 74 to identify if the centroid is located inside the particular body-area-specific mask. If 
so, the computer-generated pain shape is recorded as being associated with the specific body 
area 76, 78, 80, 82. 

Figs. 9a and 9b show examples of body-area- specific masks for the right anterior 
shoulder (Fig 9a), and for the lower back (Fig 9b), as used in the process described in Fig. 8. 
The specific outline of a body-area-specific mask is dependent on the spatial distribution of 
the centroids for the pain shapes for the patients with pain in the specific body area. Thus, the 

30 



lower back mask shown in Fig. 9b is not bilaterally symmetrical and reflects the greater 
frequency of right-sided back pain (and of right-sided sciatica) in a lower back pain 
population. 

Fig. 10 is a flow chart in which an unmarked human body image 92 is edited 94, 96 to 
add visually identifiable anatomic landmarks and anatomic landmarks detected by body 
palpation resulting in a revised human body image 102 containing both types of anatomic 
landmarks. Instructions 98, 100 as to how to identify these landmarks are given 104 to the 
person making the pain markings for a patient, resulting in a body image 106 containing pain 
markings in accordance with these instructions. In obese patients, a landmark that is visible in 
a thin person may not visible, requiring palpation rather than visual identification. 

Fig. 1 1 shows examples of anatomic landmarks identified by visual inspection 108 or 
by palpation of the body 1 10 in accordance with the process described in Fig. 10. 

Fig. 12 shows a human body image 1 1 1 in which a set of centroids 1 12 for different 
pain shapes are displayed, together with a meta-centroid 113 reflecting the center of the set of 
centroids 112. The centroid serves as a stable marker of the position of a given pain shape. 
The meta-centroid 1 13 serves as a stable marker of the center of a group of pain shapes. 

Fig. 13 is a flow chart in which pain markings of sub-optimal quality are identified for 
editing 116, followed by human editing 118, computer editing 120 or combined human and 
computer editing 122. Computer analysis of pain markings 124 is then performed to identify 
pain markings of adequate quality for subsequent computer identification of pain shape 
outlines. 

Figs. 14a and 14b show two examples of sub-optimal pain markings. Fig 14a shows a 
hatched pain shape 126 that may be converted to good quality pain markings 130 for pain 
outline identification. Fig 14b shows a stippled pain shape 128 that may be converted to good 
quality pain markings 132 for pain outline identification. 
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Fig. 15 is a flow chart in which a set of clinical variables related to pain location 134 
are combined with a set of clinical variables related to pain quality 136, resulting in greater 
diagnostic precision than is obtained by either set of variables alone 138. 

Fig. 16 is a flow chart in which a set of body image designs with computer-identified 
pain shapes 140 is used to generate three types of composite image. For the first type, the 
number of patients whose pain shape includes a given pixel is determined 142 and a 
composite image reflecting these values produced 144. For the second type, two clinical pain 
features are selected 146; then the number of patients whose pain shape shows one clinical 
pain feature is determined as well as the number of patients whose pain shape shows the other 
clinical pain feature 148; then a composite image reflecting the ratio of these values is 
produced 150. For the third type, a centroid is calculated for each pain shape 152, a meta- 
centroid is calculated for all pain shapes combined 154, radial distances from the meta- 
centroid and parametric statistics are used to determine the estimated percentage of patients 
with pain at a given pixel 156, and a composite image reflecting these values (e.g., a pain 
outline encompassing a predicted percentage of patient outlines) is produced 158. 

Fig. 17 shows an example of the third type of composite image 160 described in Fig. 
16. This example shows the estimated probability of a given outline of an individual pain 
shape in the lower back lying inside two perimeters - the perimeter of the black central area 
representing approximately 50% of outlines, and the outer dotted line perimeter encompassing 
approximately 80% of outlines. 

Fig. 18 is a flow chart for mapping the pixels in two different human body image 
designs 166, 168. The first step 170 is to identify anatomic landmarks common to the two 
designs. The second step 172 is to map the pixels for these landmarks from one image to the 
other. The third step 1 74 is to map the pixels lying along the body outlines from one image to 
the other (for example, using proportional distances between common anatomic landmarks 
along the outline or using the sliding semilandmark method). The final step 1 76 is to map the 
pixels lying on the interior of the body outlines from one image to the other, using selected 
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mapped pixels derived from 172 and 174 together with warped spaces derived from 
techniques such as thin-plate spline interpolation. 

Fig. 19 shows two human body images 178 of different design, and three examples of 
paired anatomic landmarks (for the right eye 182, the lower end of the scapula 1 84 and the 
plantar fascia 186) used as a basis for the mapping process described in Fig. 1 8. 

Figs. 20a-o show examples of the many different human body image designs used in 
the evaluation of pain, indicating the need for the process required in Fig. 18. 

It is clear that the interactions between the various components of the methods of the 
present invention follow well known clinical and computer principles and techniques, and 
need not be further described in order to avoid unnecessarily complicating the drawings and 
specification. Thus, the computer may be an IBM™PC-compatible personal computer using 
an Intel microprocessor of the Pentium or later CPU series and running the Microsoft 
Windows™ operating environment. 

Those skilled in the art will recognize that users may employ somewhat different 
image types, analytical approaches, computer hardware or computer software, all of which are 
supported by the present invention. 

There has been disclosed heretofore the best embodiments of the invention presently 
contemplated. However, it is to be understood that various changes and modifications may be 
made thereto without departing from the spirit and scope of the present invention. 
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